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Methods of Testing Results of 
Industrial Training Studied 


By EDWARD C. KEACHIE 


Professor of Business, Los Angeles State College 


Industrial training is becoming recognized as one of 
the more-significant activities of management. Training 
done by business itself has increased three-fold since 
1939.4 The close relationship of training to organization 
and management as well as to the operation of a business 
is becoming more widely recognized. The great ex- 
pansion of government and private training programs 
during the war, typified by the “Training Within In- 
dustry” program, helped bring about this recognition. 
The continued high level of indus- 
trial training has been both a fur- 
ther cause and an effect. 

‘In an effort to discover the 
strengths and weaknesses of cur- 
rent training programs, a survey 
was undertaken early in 1947 by a 
representative group of industrial 
trainers, the Training Association 
of Southern California. A princi- 
pal object was to discover how 
best to measure the results of 
training. Many training and man- 
agement men have felt, and some 
still do, that training results were 
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Income-Tax Statistics Measure 


Oregon Business Activity 
By BROCK DIXON! Bure 


Graduate Student, University of Oregon 


A study of Federal personal income-tax statistics 
for the decade beginning January 1, 1936 provides 
another verification for the commonly accepted be- 
lief that Oregon enjoyed, during the war, an increase 
in prosperity greater than that of the nation as a 
whole. Such a study also indicates that, as a measure 
of economic activity, total net income from Federal 
income-tax returns is roughly comparable to, though 
more sensitive than, the more ofter employed in- 
come-payment statistics. There is 
also a suggestion that the problem 
of income-tax evasion may be 
overrated. 

The present study compares 
total Oregon income with to- 
tal taxable income as reported 
on Federal income-tax returns 
filed by Oregon residents and 
makes a similar comparison for 
the nation.” For each year tax- 
able income was computed as 
a percentage of total income. 
The results are shown in 
Chart I. 





too intangible to be measured, and 
should be taken for granted. The 
results of the survey, however, showed that, with proper 
methods, many types of training could be evaluated quite 
concretely. These results are of significance not only for 
training people but for all managers faced with problems 
of managerial control which call for specific judgments 
of “intangible” activities. 

A brief resume of ie nature of training and evalua- 
tion will serve to point up the findings. Training is 
distinguished from education. Training is specific in- 
struction in a skill or knowledge, or both, needed to per- 
form a particular job. Education is broader in scope; it 
provides the general background needed for the job or 
for a group of jobs; the two processes overlap one an- 
other considerably. The closer the instruction relates to 
a specific job the more apt it is to be given on the job in 
the plant, office, or store—that is, in industry. 

Evaluation, in simple terms, is the comparison of 
results with objectives. When, in addition, we take action 


(Continued on page 3) 





1 National Industrial Conference Board, Inc., “Personnel 
Activities in American Business, Revised,” Studies in Personnel 
Policy No. 86, Nov. 1947. 36 p. 


The period of very rapid 
rise on Chart I, 1940, 1941, and 
1942, coincides with the period of reduced exemptions, 
so this rise is no indication in itself of increased economic 
activity. Obviously, as exemptions are reduced or as in- 
comes increase, a greater proportion of total income will 
be subject to tax. However, in a period when there are 
no substantial changes in tax laws and rates, an increase 
in the ratio of taxable income to total income indicates 
among other things increases in business activity, 
i.e., increases in profits and wages above the exemp- 
tion point. Therefore much of the significance of the 
(Continued on page 2) 





1 This is the fourth in a series of articles on Oregon economic 
development prepared by graduate students under the direction of 
Dr. Paul W. Ellis, associate professor of economics, University of 
Oregon. 

2 The term “total income” is used here to refer to the Depart- 
ment of Commerce “income payments” series, which includes all 
income of individuals except capital gains and a few other items of 
minor importance. By “taxable income” we here mean statutory 
net income or the amount remaining after business expenses and 
after personal deductions such as contributions, interest, and taxes 
are subtracted from total income reported for Federal income-tax 
purposes. The 1944 and 1945 statistics available were for adjusted 
gross income; therefore the personal deductions have not been 
subtracted from the total for those years. 
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Income-Tax Statistics Measure 
Oregon Business Activity 


(Continued from page 1) 
charted information lies in the time period in which 
Oregon's taxable income as a percentage of total 
income first rose above that of the United States. 
Oregon’s new position in this respect is particular- 


CHART I. TAXABLE INCOME! AS A PERCENTAGE OF TOTAL 
INCOME,? OREGON AND THE UNITED STATES. 1936-1945. 


100 


90 


80 


70 
ITED STATES 


60 


40 
30 
20 


lO 


| 
' 
' 
-+-—- 


i 
| 


. : 
936 1938 1940 1942 1944 1945 


' Taxable income as used here means the amount remaining after all 
business expense, and after contributions, interest, and taxes have been sub- 
tracted from total income reported for Federal income-tax purposes. 

* Total income is all income of individuals except capital gains and a few 
other items of minor importance. 

5 Sources: Statistics of Income, Part I, 1936-1945, U. S. Bureau of In- 
ternal Revenue, Washington, D. C. Survey of Current Business, Aug. 1947, 
U. S. Dept. of Commerce, Washington, D. C 
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ly remarkable in view of her position at the beginning 
of the decade covered in this study. In 1936, of a 
total Oregon income of $560 million, only 21 per 
cent or $118 million was reported as taxable income 
on Federal income-tax returns. Oregon then ranked 
well below the nation as a whole, which in that year 
included 28 per cent of a total income of $68 billion 
as taxable income. At the close of the decade, 81 per 
cent of Oregon’s total income appeared as taxable 
income on the returns, while only 77 per cent of the 
nation’s total income was reported as taxable. In- 
spection of these relationships as shown in Chart I 
for the decade reveals clearly a definite and fairly 
steady rise in Oregon’s position compared to that 
of the whole United States. 

The slight relative drop for Oregon in 1943 is 
intriguing but not explicable on the basis of the 
present study. The sudder growth of Oregon’s mili- 
tary population about that time, whose pay appears 
in total income but not in taxable income, may ac- 
count for some of the relative drop. Another possi- 
bility is that a great number of war workers coming 


. to Oregon in 1943 may have filed their Federal re- 


turns in the state of their prior or permanent resi- 
dence, although their earnings in Oregon would be 
reflected in the total income statistics of the state. It 


CHART II. TAXABLE INCOME! OF OREGON AND THE 
UNITED STATES. 1936-1945.? 
Indexes: 1939 = 100 
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can be readily shown that the military factor alone 
could be the explanation.* 

The present study of the relationship between 
total income and taxable income provides a supple- 
ment to total income as a measure of business ac- 
tivity by demonstrating the relative flexibility of 
taxable income and its sensitivity to changes in 
profits and wages above the exemption point. Thus 
in the prosperous war years most of the additions 
to total income were at individual-income levels 
above the exemption point. Each of such additions 
therefore contributed as much money to taxable 
income as to total income, thereby increasing the ratio 
of the former to the later. 

Total taxable income for Oregon and the United 
States is compared in Chart II. For purposes of the 
comparison, 1939 is taken*as the base year, i.e. 100, 
and changes were computed from that point. Total 
taxable income from all Federal income-tax returns 
for that year amounted to $23,192 million. At the 
same time total taxable income from Oregon Federal 
income-tax returns was $170 million. It will be 
noted that Oregon’s taxable total increased to an 
index of 774 from 1939 to 1945, while the taxable in- 
come total for the nation increased to an index of 518. 
The amount of the six-year increase for Oregon was 
thus 674 per cent of the 1939 level, as compared with 
418 per cent for the nation. 

The results of this study have some significance in 
connection with the matter of tax evasion. The sug- 
gestion that evasion as a problem may be over- 
emphasized in the public mind is derived from the 
1944 and 1945 figures as shown in Chart I. In 1944 
Oregonians reported to the government as subject 
to tax 80 per cent of their total income. The remain- 
ing 20 per cent must include: (1) all income of per- 
sons not required to file returns; (2) all income 
which was tax exempt by statute; and (3) all income 
which evaders failed to report. It might be that le- 
gitimate sources of discrepancy would so nearly 
absorb the 20 per cent that only a negligible amount 
of evasion could exist. 

However, certain other facts must also be con- 
sidered. Some classes of income, reportable for Fed- 
eral income-tax purposes, are not included in total 
income. (The largest of these classes, especially 
during the years since the beginning of the war, is 
believed to be capital gains, but there are others.) 
On the other hand there are classes of income which 
are included in total income but not in taxable in- 
come. Some of these are such items as interest on 
state and local government bonds and the military 
pay of enlisted personnel. If tax-exempt interest or 
military pay far exceeds capital gains in amount, the 
hypothesis of negligible evasion would be consider- 
ably strengthened. 

It would be presumptuous, on the basis of this in- 





8 Oregon’s 1943 total income was $1,572 million. The drop in 
Chart I is about 2 per cent, approximately $31 million. The annual 
pay of as few as three army divisions would probably amount to 
more than this. 
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vestigation, to do more than hazard the opinion that 
only a minor percentage of total income improperly 
escapes taxation. It should be noted, however, that 
even a small percentage may represent a very con- 
siderable sum of money. One per cent of evasion 
would have been almost $2 billion for 1945. 
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to maintain good results or to improve poor results, we 
have the elements of management control over the ac- 
tivity in question. 

The 1947 survey showed that wide varieties of types 
of training were being carried on, with equally wide 
varieties of kinds of results. Over half of the companies 
surveyed were carrying on some kind of training of pro- 
duction workers. Typical measures of the results were 
such things as increases in production, decreases in spoil- 
age or complaints, lower turnover of workers, especially 
during the learning period, and improved feelings be- 
cause of better adjustment of the worker to the shop 
and to his fellow workers. The most-widespread type of 
training found in progressive companies was training in 
human relations, followed closely by training in safety. 
These types of training, incidentally, were chiefly given 
to foremen and higher supervisors. The actual training 
was done by the conference method, which has grown in 
use as a training and management tool, especially in the 
past ten years. The results of training in human rela- 
tions are admittedly harder to pin down than the results 
of training in a manual skill, such as assembly work 
where production can be counted and errors readily de- 
tected. 

An example of factual training results is the report 
of a commercial airline, which had been having difficulty 
in handling cargo work. By the use of a specific training 
program, the following measures of improvement were 
obtained over a three months’ period: number of em- 
ployees on job, down 11 per cent; pounds of cargo 
handled per employee, up 23 per cent; baggage claims 
per 1,000 pounds, down 7 per cent ; percentage of errors 
in filling postoffice department forms, down 10 per cent. 

The fact that the errors were reduced in spite of the 
increased number of pounds handled indicates that both 
quality and quantity went up as a result of training. 
However, the training director felt that an outside fac- 
tor, “increased pressure,” might have been responsible 
for some of the increase in output. But, to quote the 
training director, “The training section assumed at least 
25 per cent of the credit for increased efficiency and got 
agreement in management that the training saved 
money.” 

Of first importance in measuring the value of train- 
ing is a factual scientific approach. The use of the control- 
group method is recommended—that is, the exhibition 
of the results of training by showing the evidence in 
terms of superior performance of those trained com- 
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pared with those who did not get the benefits of training. 
The two groups must, of course, be matched on the 
basis of their characteristics, such as age, sex, and 
amount of experience. Partly because of the difficulty of 
securing such ideal controls, another general method of 
experiment, the “before and after” technique, has often 
been used. This is particularly effective in relation to 
changes in such indicators as turnover, absenteeism, and 
accidents. ; 

A major difficulty in the evaluation of training is the 
problem technically called “the separation of the vari- 
ables,”’ that is, how much of the improvement is due to 
training, as compared with other factors. Keeping ade- 
quate records of output per man, training time per man, 
cost and savings, etc., is not easy. The analyst must get 
cooperation in many ways; his problem is often the 
homely one of getting a little extra clerical help at the 
right time or place. 

i-xamples ot ideal methods of evaluation can be founc. 
readily in the literature; they usually describe experi- 
mental studies which have been made and could be re- 
peated in industry. However, practicing industrial-train- 
ing men do not usually use refined techniques in their 
evaluations. In order to secure most of the thirty-two case 
studies received from trainers in the field in the Southern 
California Training Association survey, a very simple 
seven-point checklist form, “Measuring Training Re- 
sults,” was developed, indicating the procedural steps and 
providing space for reporting. This is shown as Exhibit I. 


Exner I 
MEASURING TRAINING RESULTS 


(1) Types of training in question: 











(2) Objectives of training: 





(3) Brief picture of conditions before training (where possible, use 
terms that tie in with training objectives; include opinions of 
those concerned): , 








(4) Records used to check training progress: 











(5) Conditions after training, as seen in terms of (3) and (4) 
above: 








(6) Factors other than training that may have helped cause these 
results: 








(7) Net tangible and intangible results fairly credited to training: 








Fortunately, the simplicity of the form did not prove to 
he a harrier to careful reporting of results ; most trainers 
furnished supplemental data both on their evaluations 
and on the training programs in question. A more-ex- 
tensive and explanatory checklist has been given in an 
earlier article, which sought to acquaint training men 
with the nature and purpose of the survey.? 





2 Edward C. Keachie, “How Effective Is Your Training Pro- 
gram?” Journal of Industrial Training, Sept.-Oct. 1947, pp. 9-14. 
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Case Studies. A simple example of a report on the 
seven-step form shown as Exhibit I concerned the train- 
ing of woodsmen in a lumber operation in the Canadian 
northeast : 


(1) Type of training in question: “Training of woodsmen, on 
the job training.” 

(2) Objectives of training: “To increase daily average wood 
cords per man.” 

(3) Brief picture of conditions before training: “Green men 


hired, placed on job with experienced men. Cut per day—experi- 
enced, 234 cords; green men after one month, 1% cords.” 


(4) Records used to check training progress : “Scaler’s records 
and production records.” 


(5) Conditions after training, as seen in terms of (3) and (4) 
above: “After instruction on four basic job units—average up to 
2% cords. Control crews verified results.” 


e 
(6) Factors other than training that may have helped cause 
these results : “Better appreciation 1 job—no other.” 


(7) Net tangible and intangible results fairly credited to train- 
ing: “With one part-time instructor, new men brought to ‘experi- 
enced’ production in one month. Less time off due to fatigue.” 


Different in scope and objectivity is the following at- 
tempt of an automobile manufacturer to check on the 
results of induction training given to newly appointed 
supervisors : 


(1) Type of training in question : “Induction training for newly 
appointed supervisors (40 hours—5 consecutive 8-hour days).” 


(2) Objectives of training: “To bridge the gap between the 
hourly-rated and the supervisory job.” 


(3) Brief picture of conditions before training: “Technical 
background, selfish motives, limited interest in people, limited 
knowledge of corporation organization, policy and procedure.” 


(4) Records used to check training progress: “A battery of 
tests to check ability and attitudes—tests on material covered— 
supervisory rating scale.” 


(5) Conditions after training as seen in terms of (3) and (4) 
above: “See attached supervisory rating scale—used as follow-up 
at end of six weeks, one year, and two years, to correlate results 
of tests and training with on-the-job achievement. (Rating done by 
two supervisors and a training staff man.)” 


(6) Factors other than training that may have helped cause 
these results: “Results colored by superior who is anxious to have 
the man recommended make good.” 


(7) Net tangible and intangible results fairly credited to train- 
ing: “Only recently started—not gone far enough to test results.” 


The idea of checking supervisory training against per- 
formance ratings and tests is promising; such a check 
has been attempted by several firms. There are two ma- 
jor difficulties—the setting up of valid rating scales and 
tests and the determination of the extent to which train- 
ing is responsible for the results. One interesting ap- 
proach to the problem, which has been made as part of 
this survey, will be described later in this article. 

The following are typical attempts to provide an objec- 
tive evaluation of the results of training, reported by three 
companies : 

(5) Conditions after training, as seen in terms of (3) and (4) 
above: Radio assemblers—“Reduced turnover and greater job ef- 


ficiency.” Mechanics—“Efficiency increase of 20 per cent to 50 
per cent, less men required for standard time jobs.” Comptometer 
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operators—‘“No necessity to hire additional operators ; work ahead 
of schedule and with less effort. Improvement in operator morale.” 


(6) Factors other than training that may have helped cause 
these results: Radio assemblers—“Induction and orientation” 
(training processes other than the one under consideration). 
Mechanics—Pep talks to foremen and supervisors. Higher rate 
cannot be obtained until after training qualifications test is 
passed.” Comptometer operators—“Comptometer machine com- 
pany providing very capable instructor possessing personality and 
ability.” 

(7) Net tangible and intangible results fairly credited to train- 
ing: Radio assemblers—“‘See No. 5” (reduced turnover and 
greater job efficiency). Mechanics—“‘Acknowledgment by rank 
and file that training is necessary for sound results. Acceptance by 
the union of the training method as a means for advancement.” 
Comptometer operators—“According to supervisor’s report pres- 
ent operators increased their output approximately 50 per cent. No 
further need for additional operators at $35 per week each. Present 
operators grateful for refresher course because they discarded bad 
habit patterris and relearned things about the comptometer machine 
from the standpoint of shape of buttons, releases, proper holding of 
fingers, etc.” 


Two additional examples show the wide possible scope 
of training and evaluation. The first report gives the 
results of training technical specialists in one small area 
of their work, cam design. Of especial interest is the 
analysis of dollar costs of training, for comparison with 
results. The often-mentioned “costs of not training” are 
pointed up in the last paragraph, which illustrates the 
fact that great savings in production costs may result 
from sound practices developed through training. 


Of the original 26 who completed the basic course in cam design, 
17 are now active in the advanced class. The group is mixed—en- 
gineer, scheduling, time study, methods, production, supervisors, 
and operators are represented. 

Instruction : vocational-school instructor. 

Classes held Friday 5 :00-7 :00 p.m. on employees’ own time. 

Evaluation: Seventeen employees will be potential cam de- 
signers. 

Operators and setup men have been using cam layout No. 1 on 
Part No. 1X X10 for years. Production 20 pc/hr. Seventy hours 
to complete manufacture of 1400 pcs. Total labor cost : $122.30. 

Cam Layout No. 2, although in stock, was never used. Knowl- 
edge and training stimulated operators’ and setup men’s think- 
ing and experimenting. 

Result : Production—32 pc/hr. 

Total hours to manufacture 1400 pcs—32 
Total labor cost—$68.25 

Labor cost saving —$54.05 

Approximate burden savings—$67.56 

Scheduling studeni reports: Knowledge of feeds and speeds, 
machine capacity, enablcs him tc give a more correct “backlog” on 
new jobs coming through his section to the manufacturing depart- 
ment. The latter, as a result of more-accurate reports, can schedule 
machines and manpower much more efficiently. Seldom repeat past 
errors such as predicting a two weeks’ backlog only to learn that 
four weeks were required in manufacturing. 


The other example is typical of the progressive work 
being done in labor relations. Too often the foreman has 
been the neglected stepchild of management. He re- 
ceives neither the information necessary to enable him 
to do a good job nor adequate consideration of his own 
problems as an employee. The training program pro- 
vided by this firm insures that the foreman will know 
the facts of the labor contract under which he is expected 
to operate. Only with such knowledge can he be expected 
to do a good job in handling the dissatisfactions of his 
men and in dealing with well-briefed union shop stewards. 
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The evaluation is a factual approach to a problem often 
regarded as “intangible.” 


(1) Type of training in question: “Training supervisors on 
union contract.” 


(2) Objectives of training: “To give every supervisor a sound 
working knowledge of selected portions of our union agreement 
with which every supervisor should be acquainted.” 


(3) Brief picture of conditions before training (where possible, 
use terms that tie in with the training objectives ; include opinions 
of those concerned): “Numerous grievances were being written 
by the union, claiming that plant supervision was not living up to 
management’s end of the agreement; and in too many cases the 
grievances were justified. In analyzing the cause, it was determined 
that there were two factors which were responsible. (a) Some 
supervisors had never even read the contract. (b) Those that had 
read the contract frequently interpreted it to fit their needs. 
The condition was so bad that practically no grievances, once 
written, were being settled at the foreman step of the grievance 
procedure.” 


(4) Records used to check training progress: “The records 
maintained were the records of the number of grievances written 
claiming violation of the mechanics involved in handling the 
grievance procedure and the number of grievances settled by the 
foremen.” 


(5) Conditions after training, as seen in terms of (3) and (4) 
above: “The training program on the union agreement was or- 
iginally set for a total of five weeks. At the end of this training 
period a true and false questionnaire was given and the papers were 
collected, although no names were required. The average of all the 
grades was 72.3. This result was not satisfactory and it was de- 
cided to extend the program for another five weeks. A new and 
different questionnaire (of equal severity with the first) was 
given at the end of the second five weeks and the average grade 
was 94.4, Since 127 men took this second test, it was looked upon 
as an indicator that our training had gotten across. In the three 
months following the completion of the program, only five griev- 
ances were written claiming violation of the mechanics of the 
grievance procedure. In four of these five grievances, supervision’s 
stand was definitely correct. The percentage of grievances settled 
by the foreman has gradually increased to where over 20 per cent 
of all grievances are settled on the floor.” 


(6) Factors other than training that may have helped cause 
these results: “No other factors can be tied in with the results at- 
tained unless we would consider the added experience which each 
supervisor gained on his own job as @ factor. In a few cases where 
supervision was new, that added experience probably contributed 
something.” 


(7) Net tangible and intangible results fairly credited to train- 
ing: “The answers to this question have already been given above. 


' In both examples which we have covered, top management was 


highly pleased with the results.” 


Returning again to the broad problem of evaluating 
supervisory training—it became apparent early in the 
survey that the idea of rating supervisors on their im- 
provement in performance due to training would be a 
good way to judge training effectiveness. Three com- 
panies cooperated on the project. Two of them conduct- 
ed an experimental trial in their plants. 

A rating scale to estimate performance improvement 
due to training was used. It was made up of two parts, 
one for self-rating by the supervisor in question, and 
one for rating by his superior. It would also be valuable 
to secure ratings by subordinates, but this was not at- 
tempted in the present cases. 

Rating-scale questions were based upon the objectives 
and content of the specific training given. Differences in 
objectives and training by companies necessitated dif- 
ferences in the wording of questions to fit each training 
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course. The objectivity of the method was fostered in 
three basic ways: (1) Reference was made directly to 
performance on the job rather than to the acquisition of 
knowledge or attitudes as a result of training. (2) Spe- 
cific questions were used to objectify the thinking of the 
respondent, to get beyond the usual generalities. (3) The 
questions were tied to specific individual supervisors 
with respect to their work, rather than calling for a gen- 
eral impression of how the “average” supervisor had 
benefited from training. 

A typical self-rating form question might be: “Have 
I personally made an improvement in safety practices ?” 
The corresponding typical question asked of the superior 
might be: “Have safety practices in his unit improved 
due to his efforts ?”’ 

Most questions were set up with a choice of four col- 
umns for rating, the choices being “none,” “‘little,” “con- 
siderable,” and “great.” This arrangement makes it easier 
to answer the questions and easier to analyze the results. 
Some questions, however, were of the completion type, 
for example : “What parts of the training have contribut- 
ed most (or least) to the improvement in this super- 
visor ?” Illustrative sections of actual rating-scale forms 
are shown as Exhibit II. 

Whenever objective data such as accident frequency 
rates are available, they should be used, even to the ex- 
tent of being written on the form before it is handed to 
the rater. Opinion should be based on the best indicators 
available. 

The inclusive dates of training form the two rough 
points of reference, during which the effects of training 
may become apparent. The ending date may well include 
a period after the completion of the actual course or con- 
ferences. This allows for some consolidation of knowl- 
edge, for putting ideas into practice (or, conversely, fail- 
ure to follow through on improved practices), and for 
lags inherent in the records which are used as a partial 
check on performance. 

The procedural steps of this method are, in brief: 


(1) Plan training-program objectives in terms of de- 
sired improvements in supervisory performance. 


(2) Set up rating-scale questions based on possible 
improvement: (a) “self-rating” form for rating by 
trainee; (b) “general” fort: for rating by superior. 


(3) Use rating scale some time after training has been 
completed. (a) Standardize conditions as much as pos- 
sible: (i) achieve uniformity in training conditions ; (ii) 
standardize rating directions and conditions; if possible, 
have the individual ratings made at one time, for each 
level of supervision, in a conference type of meeting. 
(b) Use objective records to support ratings, wherever 
possible. 


(4) Tabulate and analyze results. 


Because of the limitations of space, discussion of the 
method of analyzing results, of the variables involved, 
and of the actual findings of the companies which 
cooperated in this evaluation experiment cannot be given 
here. 
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Exugir II 


SUPERVISORY TRAINING EVALUATION— 
COMPANIES X AND Y 


ILLUSTRATIVE SECTIONS OF 
RATING SCALE FORMS 


I. Sample cover memorandum: 
Re: RESULTs oF SUPERVISORY CONFERENCES 


We have been asked to help in a research project being per- 
formed in conjunction with the Stanford University Graduate 
School of Business, the aim of which is to find out more about 
the results of supervisory training. Since few companies have gone 
into this work to the extent that we have, our ideas are being re- 
quested. Therefore, will you take a few minutes of your time to 
give us your real, honest opinion on the training we have engaged 
in? Results of the study will be available to you upon completion. 
Please try to answer the questions and give your criticism of the 
way they are arranged as well as anything else that comes to mind. 
It is hard to separate the effects of training from other factors, 
but try to answer the questions with regard to the net effects due 
to supervisory conference training alone. Omit questions on wich 
you have no informatton. 





II. Sample questions—these questions are il- 
lustrative only, since actual questions in any 
given case must be based upon the specific con- 
tent of the training given; 15 to 30 questions 
are usually used. Extra lines under each ques- 
tion are provided for remarks. 


Improvement 
If Any 





A. Self-rating scale questions: 





(1) Has improved knowledge of company 
background and operations helped me to work 
more effectively? (For example, can I make 
better allowances for conditions which are due 
to operation peculiarities of plants which 
supply us?) 





(2) Am I giving the job better overall at- 
tention? (Have I been more careful to avoid 
giving too much attention to some things at the 
expense of others just as important ?) 




















(3) Cite two instances of improvements 
made which are a fairly direct result of train- 











B. General-form questions—rating of super- 
visor by his superior : 


(1) Has his work benefited from better 
knowledge ot company background and oper- 
ations? (For example, does he show better 
understanding of conditions which are due to 
operating peculiarities of plants which supply 
us?) 





(2) Is his supervision more uniform? (Are 
the high spots less exceptional—are there few- 
er weak spots?) 























(3) If you feel that there has been an improvement, mention the 
principal way he has improved, or cite some instance of improve- 
ment in his handling of his job* 














* This type of question often received very specific and complete replies. 
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However, an intensive analysis* shows that the re- 
sults were measurable and significant. In particular, it 
was possible to show the general results of training and 
the relative values of the various parts of the training, 
and to indicate where additional training might be most 
effective. Specifically, the advantages of the method are: 

(1) It helps force planning on the part of trainer and 
management. 

(2) It focusses attention on accomplishment rather 
than activity. 

(3) It is a reminder of significant aspects of training, 
especially of relationships between training and the job, 
and between parts of the training program. 

(4) Free-answer spaces bring up comments of great 
significance, many of which would otherwise be un- 
known. Lack of anonymity is offset by the added value 
of being able to relate comments to the situation. Sup- 
plementary observations on values not covered by the 
questionnaire and suggestions for improvement may be 
made. 


(5) It is an outlet for personal feelings, criticisms, or 
expressions of opinion not previously made for various 
reasons. 


' Analysis indicates the need for some changes in the 
form, such as the inclusion of a “no improvement ex- 
pected” category. Further trial on a large scale should 
result in more-extensive finding as to both method and 
content. If Oregon business and industrial firms would 
like to adapt this technique to their problems of rating 
and training supervisors, the Training Association of 
Southern California offers its aid and would be interest- 


ed in knowing the results.‘ 


Conclusions. It has been pointed out that training 
is a personnel function of considerable significance, 
especially in its role as a catalytic agent responsible for 
increasing the effectiveness of operating departments. 

The need for evaluation as a basis for management 
control is clearly shown. The essence of evaluation is the 
comparison of results with objectives. Such objectives 
must be stated in terms of practical standards, agreed 
upon in advance of training, and modified in the light of 
experience. Evaluation then becomes management’s 
guide in the control «i the training function. 

Questionnaire techniques, to get the opinions of 
trainees and others as to the general and particular values 
of training programs are widely used. Essentially, these 
are a refinement of the process of evaluation by observa- 
tion. When carefully done, they may provide worthwhile 
information not obtainable in any other way. Poorly 
handled, they can be worse than useless, because mislead- 
ing. 

Training men are much interested in the problem of 
evaluation, and many of them have made rewarding 
attempts to evaluate their own training programs. On 
the other hand, the careful use of scientific method in 


8 Chapter 7 of the author’s doctoral thesis, The Evaluation of 
Industrial Training, Stanford University, 1948. 

* Address communications to the author, Los Angeles State 
College, 855 North Vermont Ave., Los Angeles 27, Cal. 
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evaluation is often conspicuous by its absence. The lit- 
erature contains illustrative material on-how training 
may be precisely and extensively evaluated, but actual 
examples of continuing scientific evaluation in indus- 
trial practice have not been found either in the literature 
or through this investigation. The principal reason is 
probably the practical one that real evaluation is not yet 
widely expected by management and therefore adequate 
attention is not given it. When managers generally realize 
how great the profit-and-loss effects of training can be, 
they will insist on the evaluation of results. 





Book Review 


Vaiue of Commodity Output Since 1869. By William 
Howard Shaw. New York: National Bureau of Econ- 
omic Research, Inc., 1947. 310p. $4.00. 


For a manufacturer and businessman with imagination, 
this book can be a practical tool in long-term planning. 
For the statistical department of any business, it is an 
essential reference work, with data on the production of 
numerous products or groups of products over the period 
1869-1919. Less-detailed data are shown for 1919-1939. 
This book supplements other material previously pub- 
lished by the National Bureau of Economic Research in 
which detailed data since 1919 are given. 

Executives will be particularly interested in the charac- 
ter of commodities that have grown fastest in output— 
because of the suggestions this may offer for their own 
future plans. The rate of growth of durable goods was 
found to be one-third greater than that of nondurable 
goods, even before adjustments for price changes were 
made. But prices in the period studied increased more for 
the nondurable items. Accordingly, with adjustments for 
price changes, durable goods were found to have in- 
creased two-thirds more than the nondurable. 

As in the case of all generalizations based on averages, 
some of the detail provides the significant explanations. 
For example, “most of the expansion in total consumer 
durable commodities was due not to older products but to 
three new classes : automotive equipment, household elec- 
tric appliances, and radios.” 

Statistical technicians will be interested both in the 
mass of statistical series here available and in the descrip- 
tion of methods by which totals are deflated for price 
changes. 

Many readers will be particularly interested in the au- 
thor’s analysis of variation of output and price index 
series during business cycles. The trend of both output 
and prices during the period was upward, despite the ef- 
fects of depressions. Typically, each cycle ended at a 
higher level than it began, but the rate of change was 
greatest during periods of contraction. 

Unfortunately much of the valuable material published 
by the National Bureau of Economic Research goes out 
of print rather quickly. Firms planning to develop statis- 
tical research departments will want to obtain copies of 
this book before it too is unobtainable. 

Pau W. ELtis 


Associate Professor of Economics 
University of Oregon 





CURRENT BUSINESS TRENDS IN OREGON 


Employment. Despite the heavy movement of population into 
Oregon, the number of unemployed has declined markedly the last 
few months. In August 1948 the number of persons actively seek- 
ing employment dropped to 23,400, the lowest level since the end 
of the war. Of these individuals, 16,500 were in metropolitan Port- 
land. Employment prospects in some specific industries are : 

Construction—A steady increase of 10 per cent since May will 
be followed by further gains during the summer and early fall. On 
the basis of the reports of a sample group of employers to the Ore- 
gon Unemployment Compensation Commission, it may be predict- 
ed that November employment will remain well above the July fig- 
ure and that January will not show the usual seasonal decline. 
There is still a demand for skilled craftsmen, but there is no short- 
age of unskilled workers. 

Food Processing—September is the peak of employment in this 
industry. Last year’s high of 30,000 may be exceeded if crops and 
prices are up to expectations. The coast fish canneries will be offer- 
ing considerable employment until November. 

Lumber and Logging—The immediate prospects in this industry 
are clouded by the maritime strike, which has caused some mills 
which ship largely by water to close down. Were it not for this 
unfavorable development, fall employment in the industry would 
be fully up to last year’s record-breaking level. 

Wholesale and Retail Trade—Jobbing and packing firms are on 
their way to a fall peak, but retail trade barely held its own during 
the summer months. 


Earnings of Labor. The median earnings of Oregon laborers in 
industries covered by unemployment-compensation insurance for 
the years 1942 and 1947 is shown below: 


Industry 1942 1947 
All workers $1,832 
Contract construction 1,915 
Canning & preserving 
Lumber & timber 
Transportation equipment (including shipbuilding) .... 
Wholesale trade 
Retail trade 
Finance, insurance & real estate 5 
ice not elsewhere classified 2 066 





























Consumer Prices. Portland retail prices in July were the high- 
est they have ever been. The Bureau of Labor Statistics consumers’ 
price index for moderate-income families stood at 180.3 on July 15, 
1948. This was up 80.3 per cent from the 1935-39 average and 2.6 
per cent over the level of April 15, 1948. During the three months 
preceding July 15, the price of food shot up 4.7 per cent, the largest 
increase of any of the major items in the index. Apparel prices de- 
creased slightly during the quarter; the particular items included 
in the index which were lower were: women’s and girls’ cotton 
house dresses, women’s girdles, and men’s pajamas. The important 
category of miscellaneous items was up 2.3 per cent because of the 
increase in the cost of automobile insurance, automobiles, transit 
service, and cigarettes. Decreases were reported, however, for 
dentist’s fees, laundry and toilet soap, and face powder. The de- 
tails of the index and changes since certain previous dates are given 
in the following table: 


Per Cent Change From 
Index Apr. 1948 July _ 1947 pw _~ 1939 


July 15, 1948 
(1935-39=100) July 13, 1948 July 15, 1948 July 13, 1948 


All items ........ 
Food 


Group 


NOSSSSAN 





Gas & elec. . 

Other fuel & ice 165. g 
House frnshgs. 186.4 
Miscellaneous .. 133.9 


WUMADAANA » 


Department-Store Sales. Portland department-store sales con- 
tinued to compare very favorably with those of other Pacific Coast 
cities. The percentage changes in the value of department-store 
sales compared with the corresponding period a year ago are as 
follows: 


Four Weeks Ending 


Calendar Year to 
City Sept. 11, 1948 


Sept. 11, 1948 
+11 


— 1 
+11 
5 


Portland 
Los Angeles 
San Diego 
Oakland 
San Francisco 




















+ 6 
Not available 
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Spokane 
United States 





BANK DEBITS 


Bank debits represent the dollar value of the checks drawn against individual deposits. Approximately 90 per cent of all goods, property, and services 


is paid for by check. 


ank debits are regarded as indicators of the general trend of business, though their value for this purpose may be impaired by sub- 
stantial changes in the level of prices. The Bureau of Business Research collects bank debits irom 96 banks and branches monthly. 
totals for the same month in different issues of the Review are not directly comparable because of necessary adjustments in basic data. 


On occasion, the 


Marketing Districts 


Portland (Portland, Hillsboro, Oregon City, etc.) ed 28 
Lower Willamette Valley (Salem, McMinnville, etc.).......... 





a 
ViwoO 


North Oregon — (Astoria, Tillamook, etc.) 
las, Coos 
Sout ern Oregon Ashland, Medford. Grants Pass)............. 
Upper Columbia River (The Dalles, Hood River, etc.)......... 
Pendleton area 
Central Oregon (Bend, Prineville, Redmond) 
Klamath Falls, Lakeview area 
Baker, LaGrande area 

Burns, Ontario, Nyssa 





p 
] 
North Willamette Valley (Albany, Corvallis, Eugene, etc.) 
Do 
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Reporting 


Debits 
July 1948 


$1,008,282,656 


,286,205 
89,499 
930,110 
,512, 600 
30, 750, 703 
41 240. 259 
17,266,673 
21,276,955 
15,843,178 
27,793,235 
17,809,629 

8,283,610 





Debits June 1948 Compared with 
June 1948 July 1947 June 1948 
$887,734,740 +15.7% +13.6% 
533,973,181 15.4 
66 36 


; 26. . 
97,541,004 
24,611,130 


Debits 

July 1947 
$871,681,350 
542,474,877 
67,782,096 
82,045,881 
21,511,781 
27 445,602 
33, 476, 969 
4.578, 793 212, 

2 ,473,062 15,528,967 
12,022,244 16,128,358 
24,078,699 26,579,923 
16,443,512 17,008,382 
8,347,834 9,526,145 
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BUILDING PERMITS 


Building perage @ pve an indication of Beg we operations planned rather than actual construction under way. Care must be taken, in interpretin 


these data, to al 
by the Bureau of Business Research. 


Residential 
July 1948 
Albany 


Acetavria 


Baker 














end..... 
Corvallis 


Grants Pass 
pemets Falls 


oregon City 
Portland 
Salem 


The Dalles 
21 other 


Totals 
































26,400 
411,050 
$3,867,708 











8 


New 
Nonresidential 
July 1948 


350 
5 


9,500 
324,161 





$3,915,856 


Additions, Alteratsons 


the lag which may elapse between the issuance of the permit and the beginning of actual construction. The data have been collect 


epatrs 


Totals 
July 1948 


July 1948 
$ 31,125 
60,961 


414 
232,545 


Totals 
July 1947 


Totals 
June 1948 


$ 82,666 
65,585 


4,400 40,300 60,805 
98,065 833,276 957,667 1,456,420 














$1,166,326 $8,949,890 $4,798,723 $9,332,966 
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